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Abstract 

We observe a sample of n independent p-dimensional Gaussian vectors with Toeplitz 
covariance matrix E = [o'li-jiliKijKp and tJo = 1. We consider the problem of testing 
the hypothesis that E is the identity matrix asymptotically when n —)■ oo and p —)■ oo. 

We suppose that the covariances ak decrease either polynomially ^ 

a > 1/4 and T > 0) or exponentially (X]fc>i < T for A, L > 0). 

We consider a test procedure based on a weighted U-statistic of order 2, with optimal 
weights chosen as solution of an extremal problem. We give the asymptotic normality of 
the test statistic under the null hypothesis for fixed n and p —> -l-oo and the asymptotic 
behavior of the type I error probability of our test procedure. We also show that the 
maximal type II error probability, either tend to 0, or is bounded from above. In the latter 
case, the upper bound is given using the asymptotic normality of our test statistic under 
alternatives close to the separation boundary. Our assumptions imply mild conditions: 
n = (in the polynomial case), n = o(e^) (in the exponential case). 

We prove both rate optimality and sharp optimality of our results, for a > I in the 
polynomial case and for any A > 0 in the exponential case. 

A simulation study illustrates the good behavior of our procedure, in particular for 
small n, large p. 

Key Words: Toeplitz matrix, covariance matrix, high-dimensional data, U-statistic, mini¬ 
max hypothesis testing, optimal separation rates, sharp asymptotic rates. 
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1 Introduction 


In the last decade, both functional data analysis (FDA) and high-dimensional (HD) problems 
have known an unprecedented expansion both from a theoretical point of view (as they offer 
many mathematical challenges) and for the applications (where data have complex structure 
and grow larger every day). Therefore, both areas share a large number of trends, see [12] 
and the review by m, like regression models with functional or large-dimensional covariates, 
supervised or unsupervised classification, testing procedures, covariance operators. 

Functional data analysis proceeds very often by discretizing curve datasets in time domain 
or by projecting on suitable orthonormal systems and produces large dimensional vectors with 
size possibly larger than the sample size. Hence methods and techniques from HD problems 
can be successfully implemented (see e.g. lU) .However, in some cases, HD vectors can be 
transformed into stochastic processes, see [8j, and then techniques from FDA bring new 
insights into HD problems. Our work is of the former type. 

We observe independent, identically distributed Gaussian vectors Xi, ...,Xn, n >2, which 
are p-dimensional, centered and with a positive definite Toeplitz covariance matrix S. We 
denote by X^ = {Xj^^i, ..., the coordinates of the vector Xj^ in MP for all k. 

Our model is that of a stationary Gaussian time series, repeatedly and independently 
observed n times, for n > 2. We assume that n and p are large. In functional data analysis, 
it is quite often that curves are observed in an independent way: electrocardiograms of 
different patients, power supply for different households and so on, see other data sets in [12]. 
After modelisation of the discretized curves, the statistician will study the normality and 
the whiteness of the residuals in order to validate the model. Our problem is to test from 
independent samples of high-dimensional residual vectors that the standardized Gaussian 
coordinates are uncorrelated. 

Let us denote by = Cov{Xk^h, Xk^h+j), for all integer numbers h and j, for all k G N*, 
where N* is the set of positive integers. We assume that (Tq = 1, therefore aj are correlation 
coefficients. We recall that is a sequence of non-negative type, or, equivalently, the 

associated Toeplitz matrix S is non-negative definite. We assume that the sequence {cjjljgN 
belongs to to ^i(N) n£ 2 (N), where £i(N) (resp. f' 2 (N)) is the set all absolutely (resp. square) 
summable sequences. It is therefore possible to construct a positive, periodic function 

for X G 

belonging to L2(—vr, vr) the set of all square-integrable functions / over (—vr, vr) . This function 
is known as the spectral density of the stationary series {X^^i, f G Z}. 


(-7r,7r), 


if “ 

^ ^ U + 2 cos(jx) 
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We solve the following test problem, 


Fo : S = / (1) 

versus the alternative 

ifi : S G T{a,L) such that E '"I 2 (2) 

for tp = {'tl>n,p)n,p a positive sequence converging to 0. From now on, C'>o denotes the set of 
squared symmetric and positive definite matrices. The set T{a,L) is an ellipsoid of Sobolev 
type 

T{a,L) = {E G C'>o,S is Toeplitz < L and ao = 1}, a > 1/4, L > 0. 

j>i 

We shall also test 0 against 

ifi : S G £{A, L) such that cr| > , for V' > 0, (3) 

i>i 

where the ellipsoid of covariance matrices is given by 

£{A, L) = {S G CyQ, S is Toeplitz ; ^ *^0 = 1 }) T > 0. 

j>i 

This class contains the covariance matrices whose elements decrease exponentially, when 
moving away from the diagonal. We denote by either G{T{a, L), 'll;) the set of matrices 
under the alternative Q or G{£{A,L),'ip) under the alternative Q. 

We stress the fact that a matrix S in G{'ip) is such that l/(2p)||E — /||^ > 
i.e. S is outside a neighborhood of I with radius ip in Frobenius norm. 

Our test can be applied in the context of model htting for testing the whiteness of the 
standard Gaussian residuals. In this context, it is natural to assume that the covariance 
matrix under the alternative hypothesis has small entries like in our classes of covariance 
matrices. Such tests have been proposed by [l5], where it is noted that weighted test statistics 
can be more powerful. 

Note that, most of the literature on testing the null hypothesis Q, either focus on Ending 
the asymptotic behavior of the test statistic under the null hypothesis, or control in addition 
the type II error probability for one fixed unknown matrix under the alternative, whereas our 
main interest is to quantify the worst type II error probabilities, i.e. uniformly over a large 
set of possible covariance matrices. 

Various test statistics in high dimensional settings have been considered for testing Q, 
as it was known for some time that likelihood ratio tests do not converge when dimension 
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grows. Therefore, a corrected Likelihood Ratio Test is proposed in [2j when p/n —c G (0,1), 
and its asymptotic behavior is given under the null hypothesis, based on the random matrix 
theory. In [25] the result is extended to c = 1. An exact test based on one column of the 
covariance matrix is constructed by [20] . A series of papers propose test statistics based on the 
Frobenius norm of S — see |26|, [32], [33] and [9]. Different test statistics are introduced 
and their asymptotic distribution is studied. In particular in [9] the test statistic is a U- 
statistic with constant weights. An unbiased estimator of tr(S — is constructed in 

[29], where i3fc(S) = {(Tij ■ I{\i — j\ < k}), in order to develop a test statistic for the problem 
of testing the bandedness of a given matrix. Another extension of our test problem is to 
test the sphericity hypothesis S = cr^J, where <7^ > 0 is unknown. m introduced a test 
statistic based on functionals of order 4 of the covariance matrix. Motivated by these results, 
the test Hq : S = / is revisited by |14j . The maximum value of non-diagonal elements 
of the empirical covariance matrix was also investigated as a test statistic. Its asymptotic 
extreme-value distribution was given under the identity covariance matrix by [5] and for 
other covariance matrices by [Mj- We propose here a new test statistic to test Q which is 
a weighted U-statistic of order 2 and study its probability errors uniformly over the set of 
matrices given by the alternative hypothesis. 

The test problem with alternative and with one sample (n = 1) was solved in the sharp 
asymptotic framework, as p —?• oo, by m- Indeed, |13j studies sharp minimax testing of the 
spectral density / of the Gaussian process. Note that under the null hypothesis we have a 
constant spectral density foix) = l/(27r) for all x and the alternative can be described in L 2 
norm as we have the following isometry ||/ — /o||| = (27r)“^||S — /||^. Moreover, the ellipsoid 
of covariance matrices T{a,L) are in bijection with Sobolev ellipsoids of spectral densities /. 
Let us also recall that the adaptive rates for minimax testing are obtained for the spectral 
density problem by [18] by a non constructive method using the asymptotic equivalence with 
a Gaussian white noise model. Finding explicit test procedures which adapt automatically to 
parameters a and/or L of our class of matrices will be the object of future work. Our efforts 
go here into finding sharp minimax rates for testing. 

Our results generalize the results in m to the case of repeatedly observed stationary 
Gaussian process. We stress the fact that repeated sampling of the stationary process 
(Ai^i,..., Ai^p) to {Xn,i, ■■■, Xn,p) can be viewed as one sample of size nx p under the null 
hypothesis. However, this sample will not fit the assumptions of our alternative. Indeed, un¬ 
der the alternative, its covariance matrix is not Toeplitz, but block diagonal. Moreover, we 
can summarize the n independent vectors into one p-dimensional vector X = 
having Gaussian distribution A/’p(0, S). The results by [13] will produce a test procedure with 
rate that we expect optimal as a function of p, but more biased and suboptimal as a function 
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of n. The test statistic that we suggest removes cross-terms and has smaller bias. Therefore, 
results in m do not apply in a straightforward way to our setup. 

A conjecture in the sense of asymptotic equivalence of the model of repeatedly observed 
Gaussian vectors and a Gaussian white noise model was given by [7j. Our rates go in the 
sense of the conjecture. 

The test of Hq : S = / against Q, with S not necessary Toeplitz, is given in [3]. Their 
rates show a loss of a factor p when compared to the rates for Toeplitz matrices obtained here. 
This can be interpreted heuristically by the size of the set of unknown parameters which is 
p{p — l)/2 for [3] whereas here it is p. We can see that the family of Toeplitz matrices is 
a subfamily of general covariance matrices in [3]. Therefore, the lower bounds are different, 
they are attained through a particular family of Toeplitz large covariance matrices. The 
upper bounds take into account as well the fact that we have repeated information on the 
same diagonal elements. The test statistic is different from the one used in |3j. 

The test problem with alternative hypothesis Q has not been studied in this model. The 
class £{A,L) contains matrices with exponentially decaying elements when further from the 
main diagonal. The spectral density function associated to this process belongs to the class of 
functions which are in L 2 and admit an analytic continuation on the strip of complex numbers 
z with \Im{z)\ < A. Such classes of analytic functions are very popular in the literature of 
minimax estimation, see [T2] . 

In times series analysis such covariance matrices describe among others the linear ARMA 
processes. The problem of adaptive estimation of the spectral density of an ARMA process 
has been studied by [Ej (for known a) and adaptively to a via wavelet based methods 
by [28] and by model selection by m- In the case of an ARFIMA process, obtained by 
fractional differentiation of order d G (—1/2,1/2) of a casual invertible ARMA process, [31] 
gave adaptive estimators of the spectral density based on the log-periodogram regression 
model when the covariance matrix belongs to £{A,L). 

Before describing our results let us define more precisely the quantities we are interested 
in evaluating. 

1.1 Formalism of the minimax theory of testing 

Let X be a test, that is a measurable function of the observations Xi ,..., Xn taking values in 
{0,1} and recall that G{^p) corresponds to the set of covariance matrice under the alternative 
hypothesis. Let 

r]{x) = lE/(x) be its type I error probability, and 

/3(x , G{^p)) = sup Es(l — x) be hs maximal type II error probability. 

seG(V>) 
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s 

T{a,L) 

£{A,L) 

not Toeplitz and T{a,L) [H] 

6(V^)2 

[G{a, L) ■ '‘“+1 

C(a,L) • 

/ 2 In(n^p^) \ 

\ Arfip^ j 

[G{a, L) ■ nPp) ‘‘“+1 

4q: + 1 

C(a,L) > - 


Table 1: Separation rates '0 and 6(V’) in the sharp asymptotic bounds 
where C{a, L) = (2a + l)(4a + 


We consider two criteria to measure the performance of the test procedure. The first one 
corresponds to the classical Neyman-Pearson criterion. For w G (0,1), we define, 

l3^{Gm= inf /3(x,G(V^)). 

x\v(x)<w 

The test Xw is asymptotically minimax according to the Neyman-Pearson criterion if 
viXw) < w + o{l) and /3(x^„, G(V')) =/3^(G(V’)) + o(l). 

The second criterion is the total error probability, which is defined as follows: 

7( X, G'(V^)) = ?7(x) + /3( X, G'(V')). 

Define also the minimax total error probability 7 as 7 (G(^)) = inf 7 ( x, G'(V’))) where the 

X 

infimum is taken over all possible tests. 

Note that the two criteria are related since 7(G('0)) = inf^g(o,i)('^ + (see 

Ingster and Suslina [23]i. 

A test X is asymptotically minimax if: 7 (G(V')) = 7 (x,G'(V’)) + o(l). We say that V’ is a 
(asymptotic) separation rate, if the following lower bounds hold 

x{G{'tp)) —)■ 1 as ^ 0 

together with the following upper bounds: there exists a test x such that, 

l{x,G{ip)) —^0 as ^+ 00 . 

V' 

The sharp optimality corresponds to the study of the asymptotic behavior of the maximal 
type II error probability j3w{G{'tp)) and the total error probability '^y{G{^p)). In our study we 
obtain asymptotic behavior of Gaussian type, i.e. we show that, under some assumptions, 

/3w{G{'il;)) = - nphi-ij;)) + o{l) and 7 (G(V')) = 24>(-np6(V')) + o(I), (4) 
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where $ is the cumulative distribution function of a standard Gaussian random variable, 
zi-w is the 1 — tc quantile of the standard Gaussian distribution for any w G (0,1), and hi^) 
has an explicit form for each ellipsoid of Toeplitz covariance matrices. 

Separation rates and sharp asymptotic results for different testing problem were studied 
under this formalism by |22] . We refer for precise definitions of sharp asymptotic and non 
asymptotic rates to m- Note that throughout this paper, asymptotics and symbols o, O, ~ 
and X are considered as p tends to infinity, unless we specify that n tends to infinity. Recall 
that, given sequences of real numbers u and real positive numbers v, we say that they are 
asymptotically equivalent, u ~ u, if limu/u = 1. Moreover, we say that the sequences are 
asymptotically of the same order, u x u, if there exist two constants 0 < c < C < oo such 
that c < liminf n/u and limsupu/u < C. 

1.2 Overview of the results 

In this paper, we describe the separation rates V’ and sharp asymptotics for the error proba¬ 
bilities for testing the identity matrix against G{T{a, L),'ip) and G{S{A, L),xjj) respectively. 

We propose here a test procedure whose type II error probability tends to 0 uniformly 
over the set of G(V’), that is even for a covariance matrix that gets closer to the identity 
matrix at distance 'ip ^ 0 as n and p increase. The radius 'ip in Table is the smallest vicinity 
around the identity matrix which still allows testing error probabilities to tend to 0. Our test 
statistic is a weighted quadratic form and we show how to choose these weights in an optimal 
way over each class of alternative hypotheses. 

Under mild assumptions we obtain the sharp optimality in where b{'ip) is described 
in Table and compared to the case of non Toeplitz matrices in [3] . 

This paper is structured as follows. In Section we study the test problem with alterna¬ 
tive hypothesis defined by the class G{T{a, L),'ip), a > 1/4:, L, ip > 0. We define explicitly 
the test statistic and give its first and second moments under the null and the alternative 
hypotheses. We derive its Gaussian asymptotic behavior under the null hypothesis and under 
the alternative submitted to the constraints that ip is close to the separation rate ^p and that 
S is closed to the solution of an extremal problem S*. We deduce the asymptotic separa¬ 
tion rates. Their optimality is shown only for a > 1. Our lower bounds are original in the 
literature of minimax lower bounds, as in this case we cannot reduce the proof to the vector 
case, or diagonal matrices. We give the sharp rates for ^ x Our assumptions imply 
that necessarily n = as p —>■ oo. That does not prevent n to be larger than p for 

sufficiently large a. 

In Section]^ we derive analogous results over the class G{£{A,L),'ip), with A, L,'ip > 0. 
We show how to choose the parameters in this case and study the test procedure similarly. We 
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give asymptotic separation rates. The sharp bounds are attained astp Our assumptions 
involve that n = o(exp(p)) which allows n to grow exponentially fast with p. That can be 
explained by the fact that the elements of S decay much faster over exponential ellipsoids 
than over the polynomial ones. In Section]^ we implement our procedure and show the power 
of testing over two families of covariance matrices. 

The proofs of our results are postponed to the Section and to the Supplementary 
material. 


2 Testing procedure and results for polynomially decreasing 
covariances 

We introduce a weighted U-statistic of order 2, which is an estimator of the functional 
that defines the separation between a Toeplitz covariance matrix under the alternative hy¬ 
pothesis from the identity matrix under the null. Indeed, in nonparametric estimation of 
quadratic functionals such as Ylj>i weighted estimators are often considered (see e.g. [1]). 
These weights have finite support of length T, where T is optimal in some sense. Intuitively, 
as the coefficients {o'j}j belong to an ellipsoid, they become smaller when j increases and 
thus the bias due to the truncation and the weights becomes as small as the variance for 
estimating the weighted finite sum. 


2.1 Test Statistic 


Let us denote by Tp{{aj}j>i) the symmetric px p Toeplitz matrix S = [cikli^i^k^p such that 
the diagonal elements of S are equal to 1, and crik = (Tki = <y\i-k\^ for all I ^ k. Now we define 
the weighted test statistic in this setup 


A —A^- 


n(n — l){p — T)2 


E E-i E 


l<k^l<n j=l T+l<ii,i2<p 


where the weights {'w*}j and the parameters T, A, are obtained by solving the following 
extremal problem: 


J E : s= 

(seTffi.L) 

This extremal problem appears heuristically as we want that the expected value of our test 
statistic for the worst parameter S under the alternative hypothesis (closest to the null) to 
be as large as possible for the weights we use. This problem will provide the optimal weights 
in order to control the worst type II error probability, but also the critical matrix 


AV) ■= 

i>i 


{Wj)j 

E 


sup 


j>l 


"' 1=1 


inf 




E, 




E 

i>i 




3^j- 


( 6 ) 
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S* = Tp{{a*}) that will be used in the lower bounds. Indeed, S* is positive definite for small 
enough ifj (see m)- 

The solution of the extremal problem ([^ can be found in 


= 


A = 


26 (V^) 




( 7 . 


*2 = a(i - , T = L(L(4a + l))5b • 


2a + 1 






2a + 1 


(7) 


2a(L(4a + 1)) 2 a ‘^^7^ "" Lsa (4a + l)^^ 2 a 

Remark that T is a finite number but grows to infinity as "0 —>■ 0. Moreover, the test 
statistic will have optimality properties under the additional condition that T/p —)• 0 which 
is equivalent to —)• oo. It is obvious that in practice it might happen that T > p and 

then we have no solution but to use T = p — 1, with the inconvenient that the procedure does 
not behave as well as the theory predicts. 




4a + l 


Proposition 1 Under the null hypothesis, the test statistic An is centered, Kj{An) = 0, with 
varianee : 

) = - - - . 

n(n — l)(p — r)2 

Moreover, under the alternative hypothesis with a > 1/4, if we assume that ip ^ 0 we 
have: 


Varj{An 


T 

IEE(-4n) = > h{ip) and Var^{An) 

j=i 

uniformly over S in G{T{a, L),ip), where 


_Til_ R2 

n(n — l)(p — r)^ n{p — TY' 


Ri < (p-r)2.{l + o(l)+Es(M„)-(0(\/T) + 0(r3/2-2“))+E|(M„)-0(r2)} (8) 

R 2 <{p-T)- {Ee(A) • 0 ( 1 ) + • {0{T^/^) + 0(r3/4-“)) ^ ^2 . o(r)}.(9) 


In the next Proposition we prove asymptotic normality of the test statistic under the null and 
under the alternative hypothesis with additional assumptions. More precisely, we need that 
Ip is of the same order as the separation rate and that the matrix S is close to the optimal 
T,*. This is not a drawback, since the asymptotic constant for probability errors are attained 
under the same assumptions or tend to 0 otherwise. 

Proposition 2 Suppose that n, p ^ + 00 , a > 1/4, ip ^ 0, pip^A -goo and moreover 
assume that n{p — T)b{ip) x 1, the test statistie An defined by with parameters given in 
0, verifies : 

n{p-T) (^An - Es (X)) —^ A7(0,1) 

for all S G G{T{a, L),ip), such that Es(Al„) = 0{b{ip)). 

Moreover, n{p — T)An has asymptotical M{0,1) distribution under Hq, as p ^ 00 for any 
fixed n > 2. 
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2.2 Separation rate and sharp asymptotic optimality 

Based on the test statistic An, we define the test procedure 

X* (10) 

for conveniently chosen t > 0, where An is the estimator defined in ^ with parameters in 

0- 

The next theorem gives the separation rate under the assumption that T = o{p), or 
equivalently, that —>■ oo. The upper bounds are attained for arbitrary a > 1/4, but 

the lower bounds require a > 1. 

Theorem 1 Suppose that asymptotically 

'!/—)• 0 and —)> +00 (11) 

Lower bound. If a > 1 and n^p^ = C{a,L)n^p^ —>■ 0 then 


7 = inf 7( X , G{T{a, T), -(/)) —1, 

X 

where the infimum is taken over all test statistics x- 


Upper bound. The test procedure x* defined in (10) with t > 0 has the following 
properties: 

Type I error probability : if np ■ t ^ +oo then r]{x*) 0. 

Type II error probability : if 


a > 1/4 and n^p^ = C{a,L)n^p^ if 


4q: + 1 


+ 00 


( 12 ) 


then, uniformly over t such that t < c ■ L) ■ 2 c, ^ for some constant 0 < c < 1, we 

have 

/3(x*,G(r(a,L),V’))^0. 


Under the assumptions given in © and ( |12[ ), with t verifying the assumptions of Theo¬ 
rem we get : 

7(x%G(r(a,L),V^))^0 


As a consequence of the previous theorem, we get that x* is an asymptotically minimax 
test procedure +oo. From the lower bounds we deduce that, —> 0, there is 

no test procedure to distinguish between the null and the alternative hypotheses, with errors 
tending to 0. The minimax separation rate ip is therefore : 


Ip = 


2a+ 1 


4q: + 1 


L2a (4q; -|- 1)^+2q 


2 2 
• n p 


(13) 
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It is obtained from the relation = 1. Naturally the constant does not play any role 

here. Remark that the condition T/p —>• 0 x —)• +cx) implies that n = 

The maximal type II error probability either tends to 0, see Theorem or is less than 
^{np{t — b{^jJ))) + o(l) when npt < npb{'ijj) x 1. The latter case is the object of the next 
theorem giving sharps bounds for the asymptotic errors. The upper bounds are attained 
for arbitrary n > 2 and for a > 1/4, while our proof of the sharp lower bounds requires 
additionally that n —>■ oo and a > 1. 

Theorem 2 Suppose that V’ —^ 0 such that p/T p'ilj^^°‘ —>■ +oo and, moreover, that 

X 1. (14) 


Lower bound. If a > 1, then 


inf (I{x,G{Tia,L),'tf)) > 4>(zi_^ - npb{if)) + o(l), 
x-r(x)<w 

where the infimum is taken over all test statistics x with type I error probability less than or 
equal to w. Moreover, 

7 = inf 7 ( X , G{J{a, L), V’)) > 24>(-np + o(l). 

X 2 


Upper bound. The test procedure x* defined in (10) with t > 0 has the following 
properties. 

Type I error probability : r]{x*) = 1 ~ 4>(np • t) + o(l). 


Type II error probability : under the assumption (If), and for all a > 1/4, we have that, 
uniformly over t : 


X*,G{T{a, L), V')) < 4«(np • {t - bifi))) + o(l). 


In particular, for t = , such that np ■ we have rj{x*(t'^)) < w + o(l) and also, 

fi{x*{G’),G{T{a,L),fi)) = - np-bitp)) + o(l). 

Another important consequence of the previous theorem, is that the test procedure x* ■, with 
t* = b{ip)/2 is such that 


7( X* in , GiTia, L), V^)) = 2 $ ( -np ^ ) + o(l). 


Then we can deduce that the minimax separation rate defined in (13) is sharp 
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3 Exponentially decreasing covariances 


In this section we want to test 0 against Q, where the alternative set is G{S{A, for 

some > 0. It is well known in the nonparametric minimax theory that £{A,L) is in 

bijection with ellipsoids of analytic spectral densities admiting analytic continuation on the 
strip {z £ C : \Im{z)\ < A} of the complex plane. On this class nearly parametric rates are 
attained for testing in the Gaussian noise model, see Ingster 
Let us define in ([^ 

T 


Ar = 


I 


E E ”-; E Xk Xk M-jXl,i2 Xl,r2-3, 


nin — l){p — TY , ^ ^ 

'' ^ l<k^l<n j=l T'+1<2i,22^P 


(15) 


where the weights are obtained by solving the optimization problem Q, with the 

class T{a, L) replaced by £{A^ L). The solution given in [23] is as follows : 


% = 


A = 


26(V^) 

Ai)"^ 

In ( \ 

i; 






T = 


1 


^ In — 


A 




b^(^) = 




(16) 


21n(- 

.-0 


Note that all parameters above are free of the radius L > 0. Moreover, we have : 

A 1 


^ 2(ln(l/V^))V2 


0 


Under the null hypothesis, we still have Ei{An) = 0, Var/(Al^) = l/(n(n — l)(p — T)^) 


and 


n{p — T)An Ay(0,1) for fixed n>2 and p -£■ +oo. 


In the following proposition, we see how the upper bounds of the variance have changed under 
S in G{£{A,L),'iIj). 


Proposition 3 Under the alternative, for all S G G{£{A,L),'il:i), we have : 
T 


^T.{An) = ''^^w*a‘j >b{fj) and Vars(Al^) 
i=i 


Ri 


+ 


R2 


n{n — l){p — T)^ n{p — TY 


where, for all ^ > 0, and as -0 —)• 0 : 


Ri < (p-r)2.{i + o(i)+Es(M^)-o(Vr) + E|(M^)-o(r2)} ( 17 ) 

R 2 < (p-r).{Es(M^)-o(l)+E|/2(M^).0(rV4)+E|(M^).0(T)} (18) 


Moreover, if n{p — T)b{ijj) x 1, we show that n{p — T){An — Es(Al^)) —)■ AfiO, 1), for all 
S G £{A, L), such that Es(Al^) = 0{h{'ip)). 
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Now we define the test procedure as follows, 


A* = A*{t) = l{Af,>t). 

We describe next the separation rate. We stress the fact that Lemma shows that the 
optimal sequence Wj}j in (16) provides a Toeplitz positive definite covariance matrix. The 
sharp results are obtained under the additional assumption that V’ "0 and the lower bounds 
require that n tends also to infinity. 


Theorem 3 Suppose that asymptotically V' —> 0 and p/T x p/ln{l/^j;) —)> oo. 

1. Separation rate. Lower bound: if n^p^b‘^{il}) = n^p^ • /{2\Ti{l/ Ip)) —)■ 0 

then 

7 = inf7(A,G(V')) —^ 1, 

where the infimum is taken over all test statistics A. 

Upper bound: the test procedure A* defined previously with t > 0 has the following 
properties: 

Type I error probability: if np ■ t ^ +00 then rj{A*) —)• 0. 

Type II error probability: if n^p^ fi^pip) = n^p^ ■ Afi*/i2\n.{l/'p)) —)• +00 then, uniformly 
over t such that t <c - A 2 fi‘^/( 2 ln{l/’p ))2 , for some constant c; 0 < c < 1, 

(3iA*,Gifi))^0. 


2. Sharp asymptotic bounds. Lower bound: suppose that n —?• +00 and that 


n^p^ ^ 1 ) 


(19) 


then we get inf fi^A ,G{'ip)) > — npb{'p)) + o(l), where the infimum is taken 

A:rj(A)<w 

over all test statistics A with type I error probability less than or equal to w for w G (0,1). 
Moreover, 

7 = inf 7 (A,V’)) > 2 $(-np^^) + 0 ( 1 ). 

Upper bound: we have 

Type I error probability : ri{A*) = 1 — ^{npt) + o(l). 

Type II error probability : under the condition we get that, uniformly over t. 


I3{ A*, G{'p)) < ^{np • {t - b{fi))) + 0 ( 1 ). 

2 In(n^p^) \ 1/4 


In particular, the test procedure A*{b{’p)/2), is such that 7 ( A*{b{ip)/2 ), G{fi)) = 2^{—np 


0 ( 1 ). We get the sharp minimax separation rate : ip = 


. Remark that, in this 


An^p^ 

case the condition T/p ^ 0 implies that n = o{e^), which is considerably less restrictive than 
the condition n = of the previous case and allows for exponentially large re, e.g. 

n = e^/'^. 
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4 Numerical implementation and extensions 


In this section we implement the test procedure x in (10) with empirically chosen threshold 
t > 0 and study its numerical performance over two families of covariance matrices. We 
estimate the type I and type II errors by Monte Carlo sampling with 1000 repetitions. First, 
we choose S = S(M) = [(7j]j ; aj = under the alternative hypothesis, for various 

values of M G {2, 2.5,3,4,6, 8,16, 30,60, 80}. We implement the test statistic defined in 
([^ and Q, for parameters a = 1,L = 1 and V' = ipiM) = ^Onr choice 

of the values for M provides positive definite matrices. We denote by A{M) the random 
variable n{p — T)A^ when S = and by A(0) when S = /. Note that large values of 

M give S(M) with small off-diagonal entries, which is very close to the identity matrix. 



A(0) A(80) A(60) A(30) A(16) A(8) A(6) 


Figure 1: Distributions of A{M) = n{p — T)A^ for I = S(0) and S = T.{M), when p = 60 
and n = 40. 


Figure shows that n{p — T)A^ is distributed as a standard normal random variable, when 
T, = I and Ti{M) close enough to the identity. And as a non-centered normal distribution 
when S(M) is far from the identity matrix. 

To evaluate the performance of our test procedure we compute it’s power. For each value 
of n and p, we estimate the 95th percentile t of the distribution of n{p — T)A^ under the null 
hypothesis S = I. We use t previously defined to estimate the type II error probability, and 
then plot the associated power. In Figurewe plot the power function of our test procedure 
X-test as function of for a fixed value of n and different values of p. 
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Figure 2: Power curves of the x-test as function of for n = 10 and p G {10,30, 50, 70} 


The vertical lines in figure represent the different '^{n,p) associated to different values 
of p and n = 10. We remark that, on the one hand the power grows with for all 

p G {10, 30, 50, 70}. On the other hand the power is an increasing function of p for a fixed 
covariance matrix S(M). 

We also compare our test procedure with the one defined in [6]. Recall that the test 
statistic defined by |6] is given by: 

T. E ^ 



Figure 3; Power curves of the X’t^st and the CM-test as functions of when the 

alternative consists of matrices whose elements decrease polynomially when moving away 
from the main diagonal 


15 
































Note that for matrices S G T(l, 1), we have (l/p)||S — /|||, ~ <^1) thus we implement 

/p as CM-test statistic. To have fair comparison, we estimate the 95th percentile under 
the null hypothesis for both tests. Figures shows that when n is bigger than or equal to p 
the powers of the y-test and the CM-test take close values. While when n is smaller then p, 
the gap between the power values of the two tests is large, and the y-test is more powerful 
than the CM-test. 

Second, we consider tridiagonal matrices under the alternative. We define S = S(p) = 
[aj]j ] aj = p ■ l{j = 1}, for p G (0,1). In this case the parameter 'll: is ipip) = Pj ^ grid 
of 10 points p belonging to the interval (0, 0.35] and as previously we take a = 1 and L = 1. 




'f(p) 'P(p) 





Figure 4: Power curves of the X’t^st and the CM-test as functions of V’(p)) when the alter¬ 
native consists of tridiagonal matrices 


Figure]^ shows that, the X’tsst performs better than the U-test, in the three cases : p smaller 
than n, p equal n and p larger than n. Moreover, we see that the power curves of the y-test 
and the CM-test are closer, when the ratio p/n is smaller. We expect even better results in 


this particular example if we use a larger value of a, or the procedure defined by (15) and 


(16). The question arises of a test statistic free of parameters a, respectively which is 
beyond the scope of this paper. 


5 Proofs 

Proof of Theorems and Recall the assumptions n, p —-goo, ip ^ 0 and T/p 

l/{pijj^^°‘) —> 0 . 

Lower bounds : In order to show the lower bound, we first reduce the set of parameters 
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to a convenient parametric family. Let S* = Tp({al.}k>i) be the Toeplitz matrix such that, 

al = Vx(^l-{^f^y^ forl<fc<p-l, (20) 

with A and T are given by Q. 

Let us define G* a subset of G{T{a, L),'iIj) as follows 


G* = = Tp{{ukak}k>i) , U eU}, 

where 


U = {U = Tp{{uk}k>i) — Ip and = ±1 • I{k < T — 1), for 1 < A: < T — 1}. 

The cardinality of U is 2^~^. 

From Proposition 3 in [3], we can see that if a > 1/2, for all U £ U, the matrix S/y is 
positive definite, for ip > 0 small enough. In contrast with [3], we change the signs randomly 
on each diagonal of the upper triangle of S* and not of all its elements. That allows us to 
stay into the model of Toeplitz covariance matrices and will actually change the rates of these 
lower bounds. 

Assume that Ai,...,X„ ~ A^(0,/) under the null hypothesis and denote by Pj the 
likelihood of these random variables. Moreover assume that Xi,... ,Xn iV(0,S^) under 
the alternative, and we denote Pu the associated likelihood. In addition let 

~ oT-l ^ 

U£U 

be the average likelihood over G*. 

The problem can be reduced to the test Hq : Xi,...,X„ ~ Pj against the averaged 
distribution Hi : Xi, ...,Xn ~ Pn, in the sense that 


inf l3{x,G{T{a,L),'il;)) = inf sup Es(l-x)> inf supEs(l-x) 

x-n[x)<w X-v{x)<w T.^G(T{a,L),ip) X-V(x)<w SsG* 

inf ::7i^Es(l-x) = inf E^(l-x):= inf^ /3(x,{-P7r}) 


> 




X-V{x)<w 


X-V{x)<w 


and that 


inf7(x,G'(7'(a,L),V’)) > inf 7( x , {Pvr}) + o(l) 

X X 

where, with an abuse of notation, f3{x , {-fA}) = E,r(l — x) nnd 7 (x , = E/(x) +E 7 r(l — 

x)- 

It is therefore sufficient to show that, when x 1, 

inf Pix, {-Ptt}) > ^{zi-w - npb{ip))) + o(l) (21) 
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and that 


( 22 ) 




X 2 


+ o(l)) 


while, for Un = o(l), we need that 

7(x,ra)^l. (23) 

Lemma 1 Assume that '0 —>■ 0 such that —>■ oo and let /jr be the probability density 

associated to the likelihood Pjr previously defined. Then 

f 

Ln,p := log ^{Xi, ...,Xn) = UnZn “ ^ + op{l), in Pi probability, (24) 

Ji 2 

where Zn is asymptotically distributed as a standard Gaussian distribution and Un = npb{fi) 
is such that either —)■ 0 or Un 1.Moreover, Ln^p is uniformly integrable. 


In order to obtain (21) and (22), we apply results in Section 4.3.1 of [23] giving the sufficient 


condition is (24). 


It is known that ^{Pn}) = 1 — 2 ^^^^ ~ and we bound the Li norm by the 


Kullback-Leibler divergence 


1 


\\Pi-p^\\i<K{Pi,p^). 


Therefore to show (23), we apply Lemma[^to see that the log likelihood log/^///(Xi, ...,Xn) 
is an uniformly integrable sequence. This implies that/C(P7, Pjr) = IE/(log/^///(Xi, ...,X„)) - 
0 . ■ 

Upper bounds : By the Proposition we have that under the null hypothesis n{p — 
T)An —>• AA(0,1) . Then we can deduce that the Type I error probability of x* has the 
following form : 

7?(X*) = P(Ai > t) = 1 - ^{npt) + 0 ( 1 ). 

For the Type II error probability of x* ■, we shall distinguish two cases, when n^p^b^tpf) 
tends to infinity or is bounded by some finite constant. First, assume that 'ip/'ip ^ +00 or, 
equivalently, that n^p^b‘^{fi) —)• + 00 . Then by the Markov inequality, 

lPs(X<t) < IPs (I A - Es(X)| > Es(M») -t)< 

(Es(Mn) -t)2 

for all S G G{T{a,L),fi) and t < c - b{fi) such that 0 < c < 1. Recall that under the 
alternative, we have Es(Mn) > fe(V') which gives: 


Es(-^n) - t > (1 - c)Es(Mn) > (1 - c)b{fi). 


(25) 


Therefore from the first part of the inequality (25) and the variance expression of An under 
Hi, given in Proposition 1, we have: 

i?i R2 


Es(-4.n <t) < 


+ 


n 


(n - l){p - T)Al - c)2E|(A) n{p - T)2(l - c)2E|(A) 


:=Ui + U2. 
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Let us bound from above C/i, using 

1 + 0 ( 1 ) 


and the second part of the inequality (25): 


Ui < 


^ o{Vt) + o(r3/2-2«) ^ 


o(r2 


n(n — l)(p — T)2(l — c)262(^) n{n — l){p — Tyb^if;) n(n — l)(p — T)2 ' 


We have T(^/2 x « = o(l), for all a > 1/4, which proves that : 

TJ ^ 1 + 0(1) _ ^ . 

^ ~ n{n — l){p — T)(l — cYb‘^{'il}) 

Indeed, n^(p — T)‘^h‘^{il)) —)• +oo, since n‘^p‘^b‘^{il:) —^ +oo and T/p ^ 0. 

We can check using (© that the term U 2 tends to zero as well : 

^ 0 ( 1 ) o(rV4) ^ q( 2^3/4-») o(r) 

^ “ n{p — T)b{'il)) ^ n{p — T)b^/‘^{'il>) n{p — T) 

= 0 ( 1 ) for all a > 1/4, as soon as v?‘p^b'^{'ij;) —> + 00 . 

Finally, when ■0 is of the same order of the separation rate, i.e. 'n?p^b‘^{ilj) x 1, we may 
have either Es(^„)/6(0) tends to infinity, or Es(^n) = 0{b{'ijj)). In the first case it is easy 
to see that Ui + U 2 —s- 0. In the latter the Proposition gives the asymptotic normality of 
n(p - r)(^„ - Es(^n)). Thereby, 

sup Es(^n <t) < 

SeG(Tia,L),iP) 

< 
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6 Supplementary material 


6.1 Additional proofs for the results in Section 
Proof of Lemma We need to study the log-likelihood ratio: 


Ln,p := log^(Xi,...,A„) = log exp - I)Xk - ^ logdet(S^)^ , 


where U is seen as a randomly chosen matrix with uniform distribution over the set lA. 

Moreover, let us denote A[/ = — I which is a symmetric matrix with null diagonal. 

Recall that for all U € U, tr^Ajj) = 0 and that ||Af/|| = Remember also that 

al = 0 for all \k\ >T. 

The matrix Taylor expansion gives 


(S^) ^ — I — -Au + Afj + 0(1) • Afj, 
logdet(S^) = -^tr(A^)+ 0(1) •tr(A^). 

On the one hand, tr(A^) = (c’'|)_j|)^) does not depend on U. Moreover, 


tr{Afj) < IIAjjII • ||A( 7 ||p = 2 “) = ■ — -) = o(l) for a > 1 . (26) 

n 

Thus we get 

|logdet(S^) = ^ ^ (cj|)_j|)2+ o(l). (27) 

On the other hand, we see that 


XjAuXk 


Xk,iU\i-j\CF\i-j\Xk^j 


P 

2 Uj'f'CT y, 2 T 

l<r<T i=\-\-r 


and that 


(28) 


XjAlXk 


E 


XkAX, 


h=l 


i=l h=l h=l 

h^i 

S1+S2. 


In the term S 2 , we change the variables i and j into I = i — h and m = j — h and due 
to the constraints we have |/|, \m\ G {1 ,... ,T — 1} and I 7 ^ m, while h varies in the set 


23 



{1 V (1 — /) V (1 — m), p A (p — /) A (p — m)} for each fixed pair (/, m). Therefore, 


pA{p—l)A(p—m) 
l^m ft,= lv(l—i)V(l—m) 

l<|i|.|m|<T 

We split the previous sums over I ^ m such that sign(Z • m) > 0 and get 

(p—l)A{p—m) p 


l<l^m<CT 


^rn 


E ,h+l^k,h+m + E ^k,h-lXk, 

h.= (l+Z)V(l+m) 


h—m 


h=l 


respectively, over I, m of opposite signs: sign(/ • m) < 0 and get 

p-i 

82,2 = 2 E E ^rn^k,h+l^k,h—m 

l<l,m<T h=l+m 

T-l p—l p—l 

~ 2 ^ ^ ^ ^ CT; ^k,h+l^k,h—l T 2 ^ ^ ^ ^ ^rn^k,h+l^k,h—m- 

1=1 h=l+l l<l^m<T h=l+m 

In conclnsion, we can gronp terms differently and write 

'(p—l)A(p—m) p 


X^Al,Xk = Y 

l</7^m<T 

p-l 


UiUmCrt(^m 


Y ,h+lXk^h+m T E Xk,h-iXk, 

h={l+l)\/ {l+rri) 


h—m 


h=l 


\ P p T—1 p—l 

+2 E Xk^h+lXp^h-m j T E^mEk.-.i)' + 2E E ^f^k,h+iXk, 


h-l 


h=l+m 


2=1 h=l 
h^i 


/=1 h=l+l 
T-l p-l 


Y uiu^a*iaiyp{Um,k) + YxliY.H-h\f + ‘^Y Y ^fXk,h+iXk,h-u 

l<l^m<T 2=1 h=l 1=1 h=l-\-l 

h^i 


where 

(p—l)A{p—m) p p—l 

Vp{l,Tn,k) .— ^ ^ Xk.^h+lXk^h+m~\~ ^ ^ Xk^h—lXk^h—mX‘2j ^ ^ Xk^h+lXk^h-m- 

h=l h={l+l)\'{l+m) h=l+m 

Now, let ns see that: 

W.i{XlAlXk) = ^litriXjAlXk)) = ¥.i{tr{XkXlAl)) = tr{Al¥.i{XkXl)) = tr{Al) 


(29) 


and recall (26) to get 


Eii^XjAfjXk) = 0{npiP^-Y = o(l). 


k=l 
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Moreover, we have Kj{XjAfjXk)‘^ = tr^(A^) + 2tr{Afj) by Proposition A.l in [9], which 
implies that 

n 

YaTi(^XjAfjXk) = 2ntr{A%) < 2n\\Au\\^\\Au\\]? = = o(l)- 

k=l 


Then, using Chebyshev’s inequality we obtain, 

n 

J2xJ^!jXk = opil). 


(30) 


k=l 


Thus we replace (27) to (30) in Ln,p and get 


Ln,p — 


/ P n ^ 

logEijexp ^ Ura* ^ '^Xk,iXk,i-r - - ^ UlUm(y*l <T*m Vpjl, m, k) 

Yl<r<T i=l-\-r k=l l<l^7n<T k=l ^ 

^ p n p p—l n 

Xk,h+iXk,h-i + ^ E +op{^)- 


2=1 k=l h=l 
h^i 


^<i¥^j<P 


Denote by Wi^m ■= Sfc=i ^k,iXk,m- Now, we evaluate the expected value with respect to the 
i.i.d. Rademacher variables Ur, uiUm for all 1 < r < T and 1 < ^ / m < T to get 

p ^ n 

Ln,p = log ( cosh((T; E + fog ( ^osh f-crf fj;), ^ ^ 


l<r<T-l 


i=r+l 




k=l 


p-l 


E^7* E “ E E '^h+l,h-l + ^ E + 0P{'^)- 

i=l 1<1<T—1 h=l-\-l 


We get that 

P /I 

= E fogcosh((T; E Wi^i-r)+ E (^-aia^'^Vp{l,m,k 


l<r<T-l 
P 


i=r+l 


l</7^m<T 
p-l 


k=l 


bE^*’* “ E ^h+l,h-l + J E i^\i-j\)^ +0P{P- 


*=i j-j¥='i- 


1<1<T-1 h=l+l 


^<i¥=j<P 


Note that 

n {p-l)A{p-m) p p-l 

^ y ~ ^ ^ ^Yhpl^h+m Y ^ ^ ^Yh—l^h—mY 2 ^ ^ Wh+l^h-m- 

k=l h=l h={l+l)\/{l+m) h=l+m 

v? iP 

We use several times the Taylor expansion logcosh(u) = — — (l+o(l)) for |u| —)• 0. On the 

p 


one 


hand, by Chebyshev’s inequality, |(T* E = Op{y/\np) = Op{'il;^^^°‘y/npb{'tjj)) 


2=r+l 
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op(l), as soon as -0 —)• 0. Then, 


logCOsh(c7; . ^;4( ^ 


i=r-\-l 

On the other hand, 




r V / , 1,1—r) 

i=r+l 




{p-l)A{p-m) 


p-l 


< 


y~] Wh+l,h+m + ^ Wh-l,h-m + 2 ^ Wh+l,h-m 

h=l /i=(l+Z)V(l+m) h=l+m 

{p-l)A{p-m) p 


E 


/i+m 


+ 


A 


h=l 


h=(l+l)\/ (l+m) 


+ A 


p-l 

l=l+m 


< Op{\^/^) = Op(V’^'^^"'\/np6(V')) = op(l). 


Thus we have to study now 


A 


Ln,p — lo§ p (-^1? 

JI 




2 (l + Op(l)) 


l<r<T 


2 =rH-l 


12 


<7, 




2 =r+l 


+ 4 


l</7^m<T fc=l 

P 


(31) 


*=1 


p-l 

E 

1<Z<T-1 /i=l+Z 


oE^*’* “ E E + T E i^\i-j\f+opi'i-)- 


Let us treat each term of (31) separately. We first decompose (X)f=r+i as follows, 

p 


^ := ( E 


i=r-\-l 


E EE ^k,ii^k,ii—r^l,i2^l,i2—r T ^ ^k,ii^k,ii—r^k,i2^k,i 


l+r<ii,i2<p k=l 1=1 
l^k 


k=l 


E EE 


12—r 


l-\-r<ii,i 2 <p k=l 1=1 
l^k 


+ E E ^k,ii^k,ii—r^k,i2^k,i2—r “i” E T.^h^h- 

l-\-r<i\^i 2 <p k=l l+r<i<p k=l 

:= + ^2 + ^3 


The term A3 will be taken into account as it is later on. 


26 















The dominant term giving the asymptotic distribution is : 


1 


1 




1 , 12 —r 


l<r<T 


l<r<T l+r<ii,i 2 <p k=l i=l 

l^k 

n n 

2 E E Y.Y.^k,nXk,i,-rXi^i,Xi 

l<r<T 1+T<2i,Z2<p k=l 1=1 

“ l^k 


1 


t 2 -r 


+ E E EE Xk^iiXj^i-^^—fXii^Xi^ 


12—r 


l<r<T l+r<ii<T 1+T<i2<p k=l 1=1 
~ ~ ~ ~ l^k 


1 


l<r<T l+r<'ii,^ 2 <T k=l 1=1 
- - l^k 


t 2 —r 


:= T14 + ^1,2 + ^1,3 , say. 

Recall that cr*^ = 2w*b{'ip) and then = n{p — T)An • n{p — T)b{'ip). By Proposition 
n{p — T)An AA( 0 , 1 ) and thus can be written UnZn with Zn —>• A/’( 0 , 1 ). 

Next, under P/ all variables in the multiple sums of ^1^2 are uncorrelated (as well as for 
Ai^s). Thus, 

n n 

Var/(Ai^2) = 2 ET E E EE Yaii{Xk,i,Xk,n-rX^,Xi^i,_r) 

l<r<T l+r<h<T 1+T<i2<p k=l 1=1 
~ ~ - Ijlk 

= 2 a;^{p -T){T- r)n{n - 1) < r?pT Y = 2n^pTb^{4i) 

l<r<T l<r<T 

= ‘2 ■ ul = oiul), asT/p^O. 

p 

And, similarly, 

^ n n 

Var/(Ai,3) = jY E ^EE Var/ —<f-Xi_^i2^i. 


12 —rj 


l<r<T l+r<ii,i 2 <T k=l 1=1 

l^k 


< ^ •r2n(n-1)62(V') = . ulj = o{ul) 


Therefore, + Ai^2 + Ai^s = UnZn + Op{un), where Zn —)• AA( 0 , 1 ). For the same reason, 
we have, 

n 

Var,(- af-A2) = 4 E E Y"^^^i^^f^AXk,n-rXk,i,Xk,i,-r) 

l<r<T l<r<T l-^r<ii^i 2 <p k=l 

< ^■np^b‘^{'ili) = oQ^-ulj =o{l), 

as soon as n —)■ 00 or tt„ —)• 0 . We want to show that 

® = ]^ E E = y + %(!)■ 

l<r<T i=r+l 
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Indeed, 


1 " 1 P n 

EE 


12 

1 

T2 


l<r<T i=r+l 

n p 


l<r<T 


i=r+l k=l 




l<r<T k=l i=r+l 


l+r<i-ij^i2<p 


+ l2 




l<r<T I<fci7^/c2<n H-r<2i7^^2<p 


3 

4 


^ • n(p - r) + J ^ cj;^ • n(p - r)^ + ^ ^ cj;^ • n2(p - r)^ 


l<r<r l<r<T l<r<r 

Recall that 26^ (V^) = cj*^, thus 

1^7(5) = ^•np6^(V’)(l + o(l)) + ^-n/6^(V’)(l + o(l)) + ^-nV&^(V')(l + o(l)) = ^(1 + 0(1))- 


Moreover, 


1 


VarKi?) = ^ a;8.Var,(( IRm-)") 

l<r<T 2 = 7 *+! 


+ 


1 

1^ 


a;VCov/(( IRi' 


l<r 7 ^r'<T 2 =r+l 2 '=r'H-l 

As in the calculation of the expected value of B, we can see that the term of higher order is 
obtained when we gather the indices into distinct pairs. Thus following the same reasoning 
we get 

p n 

VarK ^ = 0 (nV)- 

i=r+lk=l 

Through a very technical calculation, and using similar arguments as previously, we can prove 
that, for r / r', 

p n p n 

Cov/(( Y,Xk,iXk,i-r)\{ ^ = 0 (nV)- 


i=r+l k=l 


i'=r'+l k'=l 


Thus, 


\axi{B) = 0{\^Tri^p^) + 0(6^(V’)n^p^) = 0{'ip<^n^p*b‘^{Tp)) + 0(— • 6^(V')) = o(l). 

n 


By Chebyshev’s inequality we deduce that 
T-l p , T-l 

V n*^( ' 

12 




r=l 2=rH-l 


r=l 2=r+l 


. 2n2(p - r)262(,^) + op(l) = ^(1 + op(l)). 
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Also using that IE/(X]f=r+i = 0{n^p^), we get 


C := 


*2 *2 (P-OA(p-m) p p-l 

E E Wh-l,h-m + 2 

l<l^m<T h=l h={l+l)'V (l+m) h=l+m 

Op{X^T‘^np) = • Un) = Op(l) for a > 1/4 and since ijj ^ 0. 


Moreover, 


p-l 

F := - ^ af ^ M 4 +z,/i-i = Op{y/npb{i>)) = op{un) = op{l). 

1<1<T-1 h=l+l 


Finally, we group the remaining terms of (31) as follows, 
T-l 

2 


G := - 


JE^3-^E^u. EKi-^A + i E ('"lEit 


r=l 


2 l*-lh ’ 4 

*=i JuA* 








fc=i 

n 


2 ^ I*-Jl 

l< 27 ^:ji'<P fc=l 




^<i¥^j<p 






fc=l 


Let us note that throughout the previous proof we also showed that the likelihood ratio Ln^p 
has a variance which tends to 0, for all n > 2, when —)• 0. ■ 

Proof of Proposition . Under the null hypothesis. An is centered, and 


T 


YariiAn) = 


n(n — l)(p — T)^ 


Var/ IE“l E Xl,iiXl,il-jX2,i2A^2, 

j=l 1+T<ii,i2<p 


12-3 


Y, wf Y ^liKnKn-3^li2Kr2-3) 


nin — l){p — TA ^ 

^ ’ j=l 1+T<n,i2<p 

T 

_ ^*2 

n(n — l)(p — TY 


Recall that = 1/2 to get the desired result. Under the alternative, for all S G 


*2 

U=i^i 

G(a, L, A), we decompose An — Es(.An) into a sum of two uncorrelated terms. 

T 


^n-IEE(^n) = 


1 


n(n — l)(p — T)2 


'y ^ y ^ '^7 ^ ^ {A^k,iiA^k,ii—j ^j){^l,i2^l,i2—j U) 

l<fc7Z:Z<nj=l 1+T<ii,i2<p 
n n T p 


"^nlp-TlEE^i E (^fc.n^fc.n- 

'' A:=l j=l ii=T+l 


(33) 
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Then the variance of An will be given as a sum of two terms, 


where 


VaTE(An) = 


Ri 


+ 


R2 


n{n — l){p — T)* n{p — TY' 


Ri — ^ - crj)(X 2 ,* 2 X 2 , 42-7 - , 

7=1 T+l<i\,i 2 <p 

T p 


i?2 = 4 Es (E-; E 

jr' = l ii=r+l 


-j cTjjaj 


Let us deal first with Ri: 

-Ri = 2 ^ w*w*, ^ Es[(Xi,j^Xi,jj_j - (Tj)(Xi,*3X1,*3_j/- cr')] 

l<j,j^<T T+l<ii yis'^p 

y~! Es[(X 2 ,42-^2,12-7 - 0-7)(-^2,j4-^2,i4-7' “ 

— 2 X!/ ('^In-isl'^lu-is-i+i'l ^l*i-*3-7l'^|*i-*3+7'|)) 

.2 

= 2 ^ Z] (P-'^-\'^\)i^\rmr-j+j'\+(^\r-jA\r+j'\)) 

r=—p+T+l 

Our aim here is to find an upper bound of Ri. In Ri we distinguish two cases: the first one 
when for j = j' and the second one when j A j' ■ Let us begin with the case when j = j': 

T p-{T+l) 2 

Ri,i ;= ^ {p-T-\r\){a‘^^\+a\r-j\o\r+j\)) 

7=1 r=-p+T+l 

T P-{T+1) 2 

= 2 ^u;f ((p-r)(cj^ + cj|)+ 2 ^ {p-T-r){al + a\r-j\a\r+j\)) 


7=1 

T 


r=l 
P-(T+l) 


= + + {p - T - r){al A a\r-j\(T\r+j\)) 

7=1 r=l 

P-iT+1) 

+ 4(p-r)(cj^+u|) {p - T - r){aj + a\r-j\cr\r+j\) ■ 

r=l 

Let us bound from above each term on the right-hand side of the previous equality: 

:= 2Ywf{p-T)\ai + aY = nP-Tf{Y^f + + Y 

j = l j=l j = l j = l 


*2 4 

^7 ^7 


< 2(p-r)2(^ + 3L-(supu;])2) =(p-T)2(1 + o(1)). 


(34) 
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Now we give an upper bound for the second term of (38). Using Cauchy-Schwarz inequality 
we get, 


_P-{T+1) 


^ 1 , 1,2 := {p-T-r){a^ + air-j\(T\r+j\) 


j=l r=l 

T p-{T+l) 


P-{T+l) 


P-{T+1) 


< Hp-TfY^wf[ Y. ‘^r + i E E 

1 r=l 

2 P-{T+l) p-{T+l) 




i=i 

T 


r=l 
P-iT+1) 


< 16{p-T)^Y^f ( +( ^|r+j|) 


i=i 


r=l 


r=l 


r=l 


Again we will treat each term of the previous inequality apart. Let us see first, that if 
(r < j w* < w*). In addition to the previous remark we use the class property to get: 


T P-{T+1) T 

Ri,1,2,1 := 


3 

i=i 

T 3 


£E<(E-?+ e 


p-(T+l) 2q, 


r j — 

r=l j=l r=l 


r=j+l 


r 2 
J-"' 


s 2E(E’">0 +^<“p’“j)"E7to( E 

j=l r=l ^ j=l r=j-\-l 


T . P-(T+1) 


< 2-T-E^iAn) + (sup w*y ■ ko{a,L). 


(35) 


Indeed, for a > 1/4, we have, Ylj=ij “ 1) ^ we can take ko{a, L) = 2L^(4a — 

1)“^. Using similar arguments we prove that. 


T p-{T+l) 

Ri,i,2,2 ■■= Y^f^ 

7=1 r=l 

\r-j\<j 


„2 


P-(T+1) 

+ E 

r=l 

\r-j\>j 


2 

^\r-3\ 


P-{T+1) 

)( E 

r=l 


a. 


r+j) 


< 


T P-{T+1) P-iT+1) 

Y^ji “^h-irh-i 
i=i 




r=l 

\r-j\<j 


T p-1 

+ E« E 

7=1 r=l 

h-il>i 


\r-j\ 2 


12a 


r=l 

P-(T+1) 


A2a ^\r-. 


-d( E 


\2o 


(r+j) 2 

n2a 


r=l 


< (supiu*) • T ■ Es(^„) • L + (supiu*)^ • ko{a,L). 


(36) 
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The third term in Ri^i is treated by similar arguments: 


T P-{T+1) 

Ri,i,3 = ip-T)J 2 wf{(To+(T]) ^ {p-T-r){a‘^+ a\r-j\a\r+j\) 

j=l r=l 

T j 


T ^ P-(T+1) 


< (p- Tf ■ sup(ug + ^j) ■ + (sup wf) ^ ^ 

j -I —1 7'—^ -t -I —1 


3 

\2a 


j=l ^ r=j+l 


j=l r=l 

T P-{T+1) P-{T+1) 

+ (sup05:( 5: j: 

3 j=\ r=l r=l 

2{p - T)2|o(\/t) • Es(l„) + (supu;f) • (o(max{l, r-2“+i}) + 0(max{l, T-“+i 


J 


2a ^r+j 


2(p-T) 2. |o(VT)-Es(ln) + o 


))} 

(37) 


Put together bounds in (34) to (37), we can deduce that, 


Ri,i <{p- Tf{l + o(l)) + {p- Tf • Es(ln) • 0 (Vt) + {p- Tf • E|(X) • 0{T). (38) 


Now, we will treat the case when, j f j'. 

P-{T+l) . 

Ri,2 ■■= Y (P“ l’’l)(^|r|U|r 

l<_77^j^<T r=—p+T+1 


< ^{p-TfYY 

1<3^3'<T 


W^W., 


P-{T+l) 2 P-(^+P 

Yh l^hl'^k-i+i'|l) ■*“ ( Yh 

r=—p+T+1 r=—p-\-T-\-l 


2i 


These last two terms are treated similarly, so let us deal with the first one. By using the 
same arguments as previously, we have 


P-{T+1) 

i?i, 2,2 := Y^ I Y 1 I 

l<j^j'<T r=—p+T+1 

r^O 

P-(T+1) p-(r+i) 

^ 2 ^ W*W*,aYj\+^ Y E ^r){ Y ^|r-i+i'|)'(39) 

^<j¥^j'<T i<j¥^j'<T ^=1 r=-p+T+l 

rf^0 


We decompose the sum over j f j' over sets where {\j' — j\ < j} and {| j' — j| > j} and use 
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1 < \ j' — over the later, then similarly for sums over r: 

I j' _ O 12o 


l<3^j'<T 
\j'-3\<j 

P~('^+l) 2a , , P~(^+^) 


.■2« +4 E (E 

\3'-j\>i 


* 2 


l<j 7 ^j'<T r=l 


+ E 


r=j+l 


P-(T+1) 


E ^\r-j+j'\ 

r=—p-\-T-\-l 
\r-j+j'\<j' 


^fr-j+f\ + E 


/\2a 


r=—p+T+l 
\r-j+j'\>f 


\r-j+j. 


< 4 • (supn;^ • T • Es(X) + 4L • (supn;*)^ • 0(max{l, T-^^+i}) + ©(T^) • E|(i'„) 

j j 

+ 16L • (suprnp • T • 0(max{l, T-2"+i}) • Es(^n) + • (supru^^ . 0(max{l, r-^"+2}). 

j j 

As consequence, for all a > 1/4, 

i?i,2 <{p- T)2{Es(A) • 0{Vt) + E|(X) • 0{T^) + Ee(X) • 0(r3/2-2«) ^ (40) 

Finally put together (38) and (40) to get ([^. In order to find an upper bound for the variance 
of An we still have to bound from above i? 2 - 

-^2 = 4 ^ w*w*,ajaf ^ - aj^)] 

T+l<ii,i2<p 

= 4 WjWj,ajaji ((T|j^_j2|cr|j^_j2-j+j'| + <7|o-i2-ji'^|ii-*2+i'|) 

r+l<ii,i2<p 

P-(T+1) 

= 4 E ^ [p-T-\r\){a\r\a\r-j+j'\+(T\r-j\a\r+y\). 

r=—p+T-\-l 

Let us begin by the first case when j = f. It is easily seen that, 

T p-(T+l) 


^ 2,1 := 4^u;*V| (p-T-|r|)(cjf.|+CT|^_j|CT|^+j|) 

j=l r=—p+T+1 

< 8 L-p • (suprc*) • Es(An) 
j 

While, when j A // we can prove that, 

P-(T+1) 

-^2,2 • 4 ^ ^ ^ ^ WjWjiO'jO'ji ^ ^ {p ~ 'A — |r|)(cj|j.|(T|^_j_|_jf/| + cr|,—j|cr|j,_|_j/|) 

r=—p+T+l 

P-(T+1) 


( 41 ) 


^ 4( EE 

< 4Es(X) • (i?i,2)^/'. 


EE 


* * 
WjWj, 


^ ^ (p ^ l^l)(*^|r|^|r—j+/| “1“ ^|r—j|^|r+/| 

p+T+1 


2 \ - 
2 


We use the bound obtained in (40) to deduce that: 

R2,2 <{p-T) (e|(X) • o(r) + eE(X) • {0{tR^) + o(r3/4-“)) + Es(A) . ^ ( 42 ) 
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Put together (41) and ( [4^ to get ([^. ■ 

Proof of Proposition Assume that n{p — T) ■ Es(^n) x 1, to prove the asymptotic 
normality of n(p — T) • Am we use the decomposition (33) of the test statistic, first let us 
show that, 

n T p 

An,i ■— 2 ^ ^ Wj ^ ^ (A/j A/j ^ H 

fc=l j=l ii=T+l 

By Markov inequality we have, Ve > 0, 


n T 


k=\ j=l ii=T+l 


n ■ i ?2 


According to ([^, and under the assumption that np ■ E(M.„) x 1, we can see that, 

n • i ?2 < n-{p- r){Es(M„) • o(l) + + E|(M„) • 0(T)} 

< o(l) + 0[ - , — ) + 0( ^-— ) = o(l) since T/p — > 0 and for all a > 1/4. 

“ ^ ^ V ^n{p - T) ) \n{p-T)) ^ > 11 ' / 

Which involves by Slutsky theorem that for proving the asymptotic normality it is sufficient 
to show that, 

1 ^ 

An,2 '■= , _ X!/ ~ ~ ^j) ^ -^(Oj 1) 

(43) 

In order to prove this previous convergence, we are led to apply theorem 1 of [21]. This 
result is an application of the more general theorem of asymptotic normality for martingale 
differences, see e.g. IMj. An ,2 is a centered, 1-degenerate, U-Statistic of second order, with 
kernel //„(Ai, A 2 ) defined by. 


if„(Ai,A 2 ) : = 


1 


nin ^ - (Tj){X2,i^X2,i^-j - aj) 

^ j = l T+l<il,i2<p 


Therefore we should check that Es(ff^(Ai, A 2 )) < -|-oo and 

Es(G^(Ai,A2)) + n-iEs(g;!(Ai,A2)) 

E|(F 2 (Ai,A 2 )) 


0 


(44) 


where Gn{x, y) := E{Hn{Xi, x)Hn{Xi, y)), for x,y € MP. The proof of (44) is given separately 
hereafter. 

The asymptotic normality under S = / (the null hypothesis) is only simpler as aj = 0 for 
all j > 1, for n, p —>• 00 . However, under the null hypothesis we prove separately (hereafter) 
that 

n{p — T)An —>• AA(0,1), for p —)■ 00 and for any fixed n > 2. (45) 
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Proof of (44). To show (44), we first calculate Gn{x,y) and X 2 )). That is, 

P-(T+ 1 ) 


Gn{x,y) = 


1 


(46) 


n'^{p-Tf 

' ^ l<iiii 2 < 7 ’ r=-p+T+l 

y~l — (Xj^){yi2yi2-j2 ~ ^j2) 


l<il,i 2 <P 


Note that, under the assumption np ■ E(^„) x 1, a > 1/4, —)■ +cx) and using ([^, we 

have. 


Es(i/ 2 (Xi,X 2 )) = 


1 + 0 ( 1 ) 

2tt? 


Now, let us verify that, uniformly over S, 

Es(G2(Xi,X2))/E|(i/2(Xi,X2)) = 0(1). 


(47) 


We write 


Es(G2(Xi,X2 )) , . ^ ,^2, 


= 4n^-Es(G^(Xi,X2)) 


E|(772(Xi,X2)) 

E 

i<ii j2,i3,i4<T 

■(0'|ri|0'|ri-ji+j2| + 0'|ri-ji|0'|ri+j2|)(0'|r2|0'|r2-j3+j4| + 0'|r2-i3l 0’|r2+i4|) 


{P-T)\ 


* * * * 


E (p-r-ln|)(p-r-|r 2 | 

-p+r+l<ri,r2<p-(T+l) 


El (Tjfj)(Xl jgXl^jg-jg ) ] 

T+l<ii,i3<p 

E ®'S[(-^2,i2-’^2,12-12 “ ^i2)(-’^2,i4-’^2,i4-i4 “ O-J^)] 

T+l<i2)M^P 


(48) 


We calculate each expected value, and bound from above by the absolute value, we obtain: 


4n^-Es(G2(Xi,X2)) 

<4 El wlwtwtw* 


E 


31 32 33 34 

l<ll ,32 ,j 3 , 34 <T -p+r+l<ri ,r2 ,r-3 ,r4 <p- (T+ 1 ) 


■(|0'|ri|0'|ri-li+l2| I + |0'|ri-li|0'|ri+l2|l)(|0'|r2|0'|r2-l3+l4|l + |o’|r2-l3l 0’|r'2+l4| I) 
■(|0'|r3|0'|r3-li+l3| I + |0'|r3-li|0'|r3+l3||)(|0'|r4|0'|r4-l2+l4|l + |o’|r4-l2| 0’|r4+l4| I) (49) 


In (49) there are sixteen terms, that are all treated the same way, then we deal with, 




E 


e := 4 

I<llil 2 ,l 3 J 4 <r -p+r+l<ri,r 2 ,r 3 ,r 4 <p—(T+ 1 ) 

■|0’|ri|0'|ri-li+j2|0'|r2|0'|r2-l3+l4|0’|r3|0'|r3-li+l3|0'|r4|0'|,.4_j2+j4| | 
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To bound from above this previous quantity, we distinguish four cases, based on the indices 
Ji) J 2 ) js and jh- Let us begin by the the first case, when ji = = js = ; 




w 


,,*4 

ii 


E 


^\rif‘\r 2 ^\rzf\ri\ ^ 4-(sup (2L)^ = 0(1) = o(l) 

j ^ 


j\ = l —p+T+l<ri,r2,'r3,r4<p—(T+l) 

We consider the second case, where there are two different values of indices, either two groups 
of two, or one group of three and one separate index. For the first one, let us assume that 
(ji = i 4 , j 2 = h and ii / j 2 ), 


Q 2 ■ 4 '^i2 X!/ I^|n|'^|n-ii+i2|*^|)-2|^|r2-i2+ii| I (^0) 

l<il <T —p+T+l<ri ,r 2 ,r 3 ,r4<p—(T+l) 

•|(T|^3|(T|^3 _jj_|_j2|0'|r4|'^|r4-i2+il|l 
P-{T+l) 2 

= 4 (2koc^|ii-i2|l+ k|n|<^|n-ji+j2|l) 


^<hi^32<T 


ri=—p+T+l 

ri7^0,rif^jl-j2 


P-(T+1) 


^ 1^0 <7iji-j2i I + 


I'^h2|'^|r2-i2+ii| 


r 2 =-p+T+l 

r27^0,r2^j2-jl 


We apply the Cauchy-Schwarz inequality with respect to ri and r 2 separately to get : 

p-(T+l) P-(T+1) 

02 < 4-(2 + 2L)2 ^ • {4^bi-i2|+2( 12 ^hi|)( 12 ^ki-ii+i2|)} 

^<jl¥=j2<T ri=-p+r+l ri=-p+r+l 

ri^0,ri^jl-j2 ri^0,ri^ji-j2 


< 16 • (2 + 2Lf • ( ^ w*‘^w*‘^a?. 


Ol “^12^1^1-721 

l<ll7^l2<T 

< 16 • (2 + 2L f • {(sup w*^) ■ ^ w*^ 4 i-i 2 | 

ii=i 72=1 

T T T 


+ 2L- 


71 “^12 

l<7i7^72<'r rif^O 


+ 2L- ^ 


w 


,*2 

72 


72 = 1 


E ^InFlnl + E "^ 7 ! E 

71 = 1 ri;ri 7^0 7 l=l ri;ri^0 ^ 


} 


kil<7i 


In I>71 


< 0^1^ + 0(\/T) • E(^„) + 0^1^ • max{l, T = o(l) since E(^„) x 1/np and T/p 

Similar argument to prove that for ji = js = jh and ji / j 2 , we have. 


4 E ^71’“^72 E '^kl|'^kl-7l+72|'^|r2|'^|r3|'^|7-4|'^h4-72+7l| 

l< 7 l 7^72 <T -p+T+l<ri ,r 2 ,rz ,r 4 <p— (T+1) 


which finishes the second case. Now let us assume that we have three different values, (ji = jh 
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and ji / j 2 /is), we obtain, 


^3 := 4 Y, 


>t=2 * ^ 


Yl I^ki|^|n-ii+i2|'^k2|'^k2-i3+ii| I 

—p+T+l<ri,r2,r3,r4<p—(T+l) 

•|lT|r3|CJ|^3_jl+j3|CJ|^4|(T|r4_j2+ji| I 

p-{T+l) 

4 ^ <S*2^i3(2|%2-ii|l + k|r-irin-ii+i2|l 


^<jl¥=j2^j3<T 


ri=—p+T+l 
riT^O, ri7^j2 —ji 


p-(T+l) P-{T+1) 

I'^lii-i3l I 4“ I'^k2|'^k2-ii+i3l l) ■ (^ I'^bs-iil I 4" I'^ksl'^ks-is+iill) 

r2=—p+T+l r3=-p+T+l 

r27^0,r2^ji -j3 rs^O, -ji 

P-{T+1) 

I'^lii-i2| I 4“ Yl/ I^k4|^k4-i2+ii| l) 

r4=—p+T+l 
r-4^0,r4^jl-j2 

and hence 

T T T 

^ ^ ^2 * * 2 2 ^ / *\2 ^ ^ *2 ^ ^ 2 ^ ^ 2 
^3,1 := 2^ ^il^i2«^i3%l-j2|%l-j3l ^ Z^^Jl Z^%l-J2| Z^%l-i3l 

^<ji¥=j2¥=j3<T ^ ii=i i2=i i3=i 


< (sup^4;*)^---4L^ = o(l). 


P-(T+1) 


Note that sup < 1 and by Cauchy-Schwarz we have E l'^|r4|C|r4-j2+il| I — E |T^4. 

r 

Thus we get, 


r4=—p+T+l 
r4^0,r4 7^jl-j2 


r4 

r4^0 


^3,2 : = 


E <^l2«'i3^lil-i2l4l-i3l 

i<ii^i2^i3<'r 


p-(T+i) 

Y^ l^|r4|C|r4-j2+il| I 


r4=—p+T+1 
r4^0,r47^jl-j2 


< ■Y^tY.^*nY.^li-n\[ E <+ E ^^^41 

^ h J2 i3 k4|<i2 h4|>j2 ^ 

r47^0 ?’4^0 


1 


< (supic*) • - • 2L • (T • E(^„) + (supw*) • max{l,T | . 2L) = o(l). 


-2a+li 


Moreover, 

p-{T+l) P-{T+1) 

^3,3 := E ^ii ^i2^i3'^lii-i2|'^lii-i3l E I'^k2|'^k2-ii+i3|l E l^hrl^hr-E+iil 


i<ii^i27^i3<r 


r2=—p+T+l 
»’27^0,r2^ii-i3 


^ E<-E'^l2( E ^' 2 + E ^t^ir-2i)E'^i3( E ^" 4 + E ^:S^<4i 


r 4 =—P+T+l 
r-4^0,r4^jl-j2 


|r4p“ 2 


r 7 

ii E h2|<i2 |>’2|>i2 ^ 33 h4|<i3 k4|>i3 

r2^0 )'27^0 7'4f^0 »’47^0 

< • E(^„) + (supip*) • max{l,r“^"’''^} • 2L'j = o(l) 

2 \ j J 


n 
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and 


Gza 


E 

^<h¥=32^h<T 


P-{T+1) 

^ 31 ^ 32 '^j3^\j2-jl\ I^|?'2|'^|»'2-il+i3| I 

r 2 =—p+T+l 
r 27 ^ 0 , r2^ji-j3 


P-(T+1) 

\^\r3\^\r3-j3+ji\\ 


r 3 =-p+T+l 

r3^0,r3^j3-jl 


P-iT+1) 

yy |cJ|^4|CJ|^4_j2+ji| I 


r4=—p+T+1 
r-4^0,r4^jl-j2 


2o 


^ E<-E^l2( E ^' 2 + E E <+ E 

\r2\<j2 \r2\>j2 ^ 3 


I T* ,1 I 

F4| 2 


J 3 


r’27^0 


r2 7^0 


k4|<i3 

7’4^0 


k4|>i3 


31 32 

= o{l). 

Similarly we show that 

p-(T+l) P-iT+1) 

^3,5 := E ^3i'^32'^j3 E I'^kil'^ki-ii+Ell E I'^k2|'^k2-ii+i3|l 

l<jl^j2^j3<T ri=—p+T+1 r 2 =—p+T+l 

ri^0,ri^j2-ji r2^0,r2^ji-j3 

P-iT+1) P-iT+1) 

yy I'^h3|^h3-i3+ii| I y^ I'^|r4|'^|r4-i2+ii|l~®(^)- 

r 3 =—p+T+l r 4 =—p+T+l 

r3^0,r3¥=33-jl r4,^0,r4^ji-j2 

Finally, when all indices are pairwise distinct. We use the same arguments as previously, and 
we get, 

yy \^\r\\^\r4-j4+j2\^\r2\^\r2-33+3A I 

—p+T+l<ri,r2,'r3,r4<p—(T+1) 

•|lT|^3|CJ|^3_jl_|_j3|CJ|^4|(T|^4_j2+j4| | 

= 4 ^ «^j>j>j>j4(2^okbi-i2|l+ E l^lnFln-ii+i 2 |l) 

1 <ii 7 ^i 2 ^i3 ^i 4 <T r 17 ^ 0 , r 1 ^ jl -72 

(^2 (To |cj|j3_j4| I + I'^h2|'^|r2-i3+i4| I ) (^ ^0 I'^lii-i3l I + I'^k3l^k3-ii+i3|l ) 

r2T^0,r2^j3-j4 f3^0, r3^ji-j3 

(^2 (To |cj|j2_j4| I + |(T|r4|(T|r4_j2+j4| I ^ 

r4 7^0,r4^j2-i4 

Now, we treat each term of Q 4 separately: 


54 := 4 

i<ii7^i2^i3^i4<T 


* * * * 


04,1 :— 


< 


< 


_* _* _* 


yy '^32 '^33 ^ 34 ,1 ^lii - 32 1 *^1 i3 -i41 ^lii -is I “^lis -i411 

1<3i¥=32¥=33¥=34<T 


E * * 2 

^il^i2^bl-j2| 


E * 4= 2 

^ii^is^bi-jsl 


E * * 2 


E * * 2 

V34%3-H\ 


31,32 


31,33 


32,34 


33,34 

2q 4 2 


^ -(E^ E Ei-.2i4i-i2i+(s^p^l)-E E 42?' 4 i-.2| 

ii i 2 ii 32 2 

i2<lii-i2| i2>lii-i2| 


(o(v/r) • Es(l„) + o(^) • max{l,r-2“+i} • l)E o(1) 


•v/T 
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and 


Qa,2 := 


< 


< 


< 


^ l'^k4|'^|7-4-i2+i4|l 

^<jl¥^j2^jz¥^ji<T 7’47^0, 'r47^j2-j4 


EE 


* * 
^J2^i4 




E * 2 

^h%,-32\ 


Y.<^Iz-3.\ 


32,3 A 


E 


Ji 3Z 

^|r4| + 


31 


33 


E 


^2 

'^k4| 


r47^0, r4^j2 -i4 
k4|<i2 


r47^0,r4^j2-i4 

\ri \<32 

1 


31 33 ^ 


* * 
^J2^i4 


J2J4 


r 4^0 

\rA\<32 


32,3 A 


E 

r47^0 

\rA\<32 


^2 
•2a *^^41 
32 


< ( 0 (Vf) ■ Es(X) + O(^) • max{l, T-2“+1}) " • o( 


Vf^ 


■ (sup w*) ■ Es(^n) + T ■ (sup w*)"^ ■ max{l,T 


l,*^2 

3 3 


-2a+l 


■ L 


1 


(0(\/T) • Es(X) + 0(^j • max{l, T-2“+1} 


• 2L 


(t • Es(l„) + O(^) • max{l,r-2«+i} . l) 


= o(l) since E(^„) x 1/np and for all a > 1/4. 


We use similar argument as previously to show that the remaining terms in Q 4 tend to zero. 
To complete the proof, we need to verify that, 


Es(F^(Xi,X 2 ))/E|(i 72 (Xi,X 2 )) = o(n). (51) 


We write 


EE(B:i(X4,X2)) _ 1 ^ 

El,(ff2(X4,X2)) (p-T)4 , , 

Es[(Wi,i,Xi,i, 

—ii *^11) (^ 1 ,* 3 ^ 143 —72 

•IEs[(-E2,i2W2,i2-ji - fTji)(X2,* 4 X 2 ,*4-^2 


* * * * \ \ 

^il^j2^j3^i4 2^ 2^ 

T+l<ji,i3,i5,i7<p T+l<i2,*4,*6 48<P 

~ '^i2)(^l,i5^1,*5—i3 ~ '^i3)(^l,*7^1,i7—74 ~ *^14)] 
“ '^i2)(^2,i6W2,ig—jg — (Tj3)(W2,igX2,ig—j4 — CTj^)] 


To bound from above the previous sum, we replace the expected value by it’s value, which 
is a sum of many terms, that are all treated similarly. So let us give an upper bound for the 
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following one : 


n := 


< 


jl,j2,j3,j4, T+l<ii,i 3 ,i 5 ,ir<p T+l<i2,i4,*6,*8<P 

'^\i5-i7\'^\i5-i7-j3+j4\^\i2-i4\^\i2-i4-jl+j2\^\i6-i8\^\i6-is-j3+j4\ 

'^jl^j2^j3'^j4 ^|r-l|'^|?’i-jl+i2|'^|r'2|'^|r2-ii+i2| 

jl ,j2,j3,34 -p+l<ri , 72 , 73,74 <p -1 

■<y\ 7 ^\a\j.^ -is +i41 '^k41 *^1 74-33 +34 1 


We see that % can be treated in the same way as Q. However, we show that % = 0(1) = o{n). 
Let us deal with one of the terms of %, consider the term for which we have ji = j 2 , J 3 = j 4 , 
and jl / ja thus we get 


E 

i<ii7^i3<T 


*2 *2 

•"i. 


E 

—p+l<ri ,r2 ,^3 ,r4 <p— 1 


2 2 2 2 
^\7lf\72f\73f\74\ 


< 2 


EE 

^<3i¥=33<T 


*2 *2 
*“4 ”■* 


+ 2 EE 

i<ii7^i3<r 


*2 *2 

•"j. “A 


E 

riT^O 


^2 

^kil 


E 

i<ii7^i3<T 


*2 *2 
^il^is 


(To + 


E 

ri^O 


(T| 


hi I 


It is easily seen that EE WpW*^ = 0(1). And so on, we show that all terms in T-l are 

^<3i¥=32<T 

0(1) and thus we get the desired result. Together with (47), this proves (44). In consequence. 


we apply theorem 1 of [ 21 ] , to get (43). 

Proof of (45). We define Bn,p as follows, 

n p p 


T-l 


K — 

*^n,p — 


/ / _ w _ _T ^ ^ Xk,iXk,i-jXi^hXi^h_j 

\/n{n l)(p T){p T i=T+ih=i+ii<k^i<n 3=1 


We set 

D 


T-l 


n,p,i - !— - — - ^ - - —— X] X] X] Xk,iXk,i-jXi^hXi^h-j 

^n{n -l){p-T){p-T-l) i<k^i<n i=i 


T-l 


:= c 


{n,p,T) ^ ^ y~] w* Xk^jXk^i-jXi^hXi^h-j 

h=i-\-l l<k^l<n j=l 


Note that the {Dn,p,i}T+i<i<p is a sequence of martingale differences with respect to the 
sequence of cr fields {Xi,i > T + 1 } such that T) = cr{W,r < i}, we denote by Ei(-) = 
K{-/Xi), where E is the expected value under the null hypothesis. Indeed, for all T+1 < i < p, 
we have, Ej_i(Zl„^p^j) = 0. We use sufficient conditions to show the asymptotic normality of 
a sum of martingale differences Bn,p for all n > 2, as (p — T) —)> 00 , see e.g. |30|. Thus it 
suffices to show that, 

®'( ^ ^i-ii^n,p,i) ~ ^0 and ^ E(T)^p j) —> 0. (52) 

i=T+l i=T+l 
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We first show the first part of (52). 


= ic{n,P,T)f ^ Y WjW*^Xk,i-jXk,i-j^Ei_i{Xi^h-jXi^h-n) 

h=i-\-l l<k^l<n 

{i+jl-l)A{i+j-l) 

= {c{n,p,T)) ■ ^ ^ ^ ^ ^ '^j'^j\^k,i—jXk,i—ji 'y ^ Xi^ki—jXi^fi—j-^ 

l<j,ji<<T—1 l<k^l<n h=i^l 

n T 

+ (»^ - 1) X] wfxli-j{p -i-j + l) 

k=l j=l 

giving 


E( ^ 

i=T+l 

p T-1 p T-1 

= c‘^{n,p,T) ■ (n{n-l) Y Y~ ^ ~ Y Y'^f^P~'^~^^^ 

i=T-\-l j=l i=T-\-l j=l 

A P 

= - -=ry- - -- Y Y (P “ *) = 1- 


Thus, to show that Y^ J—1^ —)• 0, it is sufficient to show that E^ Y^ ^i-i{P^n,p,i)^ 

l + o(l). Indeed, 


i=T+l 


i=T+l 


^ 2 

e ( Y ^i-i{Dlp,i)) ={c{n,p,T)f-(Ei+E2 + E^ + E^. 


(53) 


i=T+l 


where Ei,E 2 , E^ and E 4 are given by the following. 


(j+i-l)A(i+ii-l) ii'+j'-l)A{i'+j[-l) 

= EEEEE E E 

T-\-l<i,i'<pl<k^l<n l<k'^l'<n l<j'J'^<T—1 h=i-\-l h'=i'-\-l 

'^i^k,i-jXk,i-j^Xi^h-jXi^h-jxXki^i'-j'Xk!^ii-j'^Xp^hf_jiXi, 


Now we decompose Ei into five sums that depends on the indices k, A:', I and I' . We begin by 


41 




the first case when k = k' and I = I' 


Ei,i ■■= Yj ( ^ “ 1) + (J “ 1)(J - 2)) + Yj 

l<k^l<n \i=T+l j=l l<j¥=j'<T 

+ 2 Y1 ((■?’ “ ^ “ 1 )) 


((j - 1) A (ji - 1)) 


+ Y1 ( + (j-!)(/-1) 

T+l<i^i'<p j=l l<ji=j'<T 


= n n — 


{»-!) h t E wf{j - l)(j + 1) + 2 E E<o--i) 

y ^=TH-1 j=l T-\-\<i^i'<p j=l 


+ E E <«^f(i-l)(/-l) + 2 wfwf({j-l)^{j'-l) 

T+l<i,i'<p l<j,j'<T i=T+l l<ji=j'<T-l 


When k = I' and I = k', we have using similar arguments as previously that, 


El ,2 = n{n-l) Y 

T+l<i,i'<p l<j,j'<T 


We move to the term, when k = k' and I ^ I', 

^h3 := E {E^f( E 3(j-l)2+ (j-1)") 

j=l i=T^l T-{-l<ij^i'<p 

+ E E (i-i)(/-i)} 

T-\-l<i,i'<p 

= n{n-l){n-2) (2 Y E E wfw*?{j-l){f-l)^ 

i=T+l j=l T+l<i,i'<p l<j,j'<T-l 


Now we treat the case when , k ^ k' and 1 = 1', 


T-l 

:= E {E< E (3(i-l) + (j-l)(j-2)) 

l<k,k\l<n j=l T+l<i,i'<p 
l^k^k\k^k' 

+ E E 

T+l<i,i'<p 

T-l 

= n(n - 1) (n - 2) Y { E + E ' O' “ 1) (/ “ 1) } 

T+l<i,i'<p j=l l<j^j'<T 

T-l 

= n(n-l)(n-2) Y ( E O'“ !)(/“ 1) + 2 E ) 

T+l<i,i'<p l<j,j'<T-l j=l 
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Finally, we treat the term for k ^ k' and I ^ I', 


:= Z] Z] Z Z 

l<kj^l<n l<k' <n T^l<i,i'<p 
k^k',l^l' 

= n{n-lf{n-2) ^ ^ wfw*?{j-l){f-l) 

T+l<i,i'<pl<j,j'<T 

We group the previous result to get, 

El = ^2?T,(n — 1) + 2n(n — l)(n — 2) + n(n — l)^(n — 2)^ ^ ^ w*‘^w*? {j — l){j'— 1) 

T+l<i,i'<pl<j,j'<T 

+ Ri{n,p,T) 


where, 


Ri{n,p, T) 

T-l p T-1 

2^n(n — 1) + n{n — l)(n — 2 )) E E w*^{j — 1) + 2n(n — 1) E E-fy- 1)0 + 1) 

i=T+lj=l 


T-l 


T+l<i,i'<p j=l 
p T-l p 

+ 2n(n — l)(n — 2) E E — 1)^ + 2n(n — 1) 

i=T+l j=l i=T+l l<j^j'<T-l 

= o{{c{n,p,T)-‘^) 


Now, let us bound from above the term E 2 in (53): 


n T 


E 2 := (n - 1) E E E EE>">;. w*?E{Xk^i-jXk^i-j-;^Xl/^^,_j,){p — i' — j' + 1) 

T^l<i,i'<p l<k^l<n k'=l j'=l 

{i+j-l)A.{i+ji-l) 

We treat the two cases k = k' and k ^ k' each one apart. We begin by the case when k ^ k', 

T-l p 

E 2 ,i ■■= n{n-lf Z •3(p-*-J + l)(j-l)+ Z i + 1)0’ “ 1) 


+ z 

l<j¥=j'<T 


j=l i=T+l 

P 

*2 *2 
Wj Wj, 


T-\-l<i^i'<p 


Z + 1)0’ - 1 ) + Z (p-i' -f + i)(j -1 

i=T-\-l T-\-l<i^i'<p 

p T—1 

{"-F{2 e e wf {p-i-j + l){j - 1) 


= n[n — 

i=T+lj=l 

+ E E 

T+l<i,i'<p l<j,j'<T-l 
When k ^ k', 


*2 *2 
^3 ^3 




-^ 2,2 := n{n-lf ^ ^ wfwf{p-i'-j' + l){j-l). 

T+l<i,i'<p 1<3,3'<T 
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As consequence 


E 2 = {n{n - if + n{n - ^ ^ wfwf{p-i'-j+l){j-l) + o{{c{n,p,T)f. 

Similarly we get, 

n T-l 

= {n-l) Y. E E + 

r+l<i,i'<p l<k'^l'<n k=l j=l 

= n^(n-l)^ Y E + 

r+i<i,i'<p i<i,i'<T-i 


p T-l 

+ 2n{n — 1)^ E E wf {p-i- j + l)(j - 1) 

i=T+lj=l 

The term Ei of ( [^ is treated as follows, 

E, := (n-lf Y E E wfw*fE{Xl,_^Xl^p_j,)ip-i-j + l){p-i'-j' + l) 

Tf-l<i,i'<p l<k,k'<n 

= n(n-l)2| E ( E wf3{p-i-j+ lf + Y wfwf{p-i-j + l){p-i-j' + l)'^ 

i=T+l l<j<T l<j¥^j'<T 

+ E E wfwf{p-i-j + l){p-i'-j' + l)'^ 

T+l<i^i'<p l<j,j'<T-l 

+ n{n-lf Y E wfwf{p-i-j + l){p-i'-j' + l)^ 

T+l<i,i'<p l<j,j'<T-l 

T+l<i,i'<p l<j,j'<T-l 


+2n{n-lf E E '^j^iP ~~ 3 
i=T+l l<j<T 

Finally we group all the previous terms and obtain. 


e( E 

i=T+l 


2 

n,p,i 


= c^{n,p,T)^-n‘^{n-lf Y E (O'-!)(/-1) 

T+l<i,i'<p l<j,j'<T-l 

+ {p-i' - f + l)(j - 1) + (P - * - J + !)(/ - 1) 

+ {p - i - j + f{p - i' - f + f) +o((c(n,p,r))“'^) I 

= ^ E ip-i){p-i')) + oii). 

1 ({p-T-l){p-T)\2 


16 

(p-r)2(p-r-i)2 ■ 4 


’) + 0 ( 1 ) = 1 + 0 ( 1 ) 
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To achieve the proof, we show that the second condition given in (52) is also verified. Indeed, 


= {c{n,p,T)f Y. Y. Y Y Y Y 

i=T+l i=T-\-l I<k4^l4<n 

Y1 j 2 '^ 

l<il J2,i3j4<r-1 

/jj JC;2,h2-^i3,/l3^U,/l4-^fcl,*—n-^fc2,*—^ 4 ) 

= 0 (i).(c(„.p,r))‘. t. Y. Y. Y. Y. 

i=T-\-2 TH-1</i,i,/i2<P 

0 ( 1 ) 


* 2 * 2 
w ■ w ■ 

^j 2 


(p-T)2(p-r -1)2 


(p-r)^ = o(i). 


6.2 Proofs of results in SectionlS] 

Proof of Proposition To show the upper bound for the variance of A^, we follow the 
line of proof of Proposition We use that Ylj>i l/(e'^"^-^) = l/(e”'"^ — 1) for all A > 0 and n 
finite integer. As an example, let us bound from above one term of the variance of A^ ■ 


Ri, 2,2 


Y 


* * 
w^w^, 


P-{T+1) 


^\i'-j\\+ Y 


\a\r\cr\r-j+j'\ 


r=—p+T+1 
rT^O 


p-(T+l) p-(T+l) 


< 


< 


w*w*,af„_j^+4: Y ^>i'( Y Y 


2 

i<m'<T i<j^j'<T 

2 Y + ^ Y 

i<j^j'<T i<j^i'<T 

\3'-j\<j \j'-j\>j 

p—(T+l) 2Ar P—{T'+^) 

® 2 


k-i+iT 


r=l 


r=—p+T+1 
r^O 


e2^li'-il „ 
p2Aj ^\r-j\ 


E (E 

i<i/T<'r r=i 


* 2 
w ra^ 


+ Y 


o2.Aj 


(Jr 


Y '^\r-j+j'f\r-j+j'\+'^r Y 


r=j+l 


r=—p+T+l 

V-i+j'\<j' 


p-^1) 2A\r-j+j'\ 

_ 2 

^ 2 Aj' ^\r-j+j'\ 

r=—p+T+l 

k-i+TI>i' 

rS t 7E\ 


< 4 • (supu;*) • T • Es(A^) + 4L • (supu;*)2 • (l/(e2^ - 1)) + 0{T^) • E^(A^) 

j j 

+ 16L • (suprc*) • T • (l/(e^^ — 1)) • Es(A^) + 16^2 • (supic*)^ • (l/(e^"^ — 1))^. 
j j 


The proof of the asymptotic normality of n{p — T){An — Es(A^)), when n{p — T)b{ilj) x 1 
and for S G G{S{A,L) ,ip) such that E 2 (A^) = 0{b{ijj))^ is also due to Theorem 1 of [21]. 
That is, we have to check (|44[) as in Proposition]^ As an example, let us bound from above 
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the term Q 2 in ^50^ with the parameters given in (16): 


52 := 4 


*2 *2 


|(T|ri|(T|ri_ji_l_j2|0'|r2p|r2-i2+ii| I 

—p+T +1 <ri ,r 2 ,r 3 ,r4 <p— (T+l) 

• I Cr|^31 I f^|r41 '^|r4-j2+ii 11 


< 


^ E 

i<ii7^i2<T 

< IGL^ 


*2 *2 / 


*2 *2 / 
^i2 


i<li#i2<7’ 


ri 

kil<ii 


ri 

|n|>ii 


< 16 L 2 | ^ w*^{ Y ^|r-irin|)'+ E 

i<ii^i2<r 


„2Ari 


< 


< 


ri r2 

^ Y1 

L 

(E 

ri 

|n|>ji 

E(E O ■ 

1 

} 


*2 *2 / 
W-W 
^J 1 ^J 2 


i<ji#i2<r I yi . 


Jl 32 


IGL^I^ • + AL^ -y (supu;f) • ^ 


32 

3 ''~e2A_l 


< E|(l^).o(r) + o(i) = o( 


'n?{p — r)2 


r) + 0 ( 1 ) = o(l)- 


(54) 


Proof of Theorem To show the upper bound, we use first the asymptotic normality 
of the n{p — T)An under Hq to prove that the type I error probability of A* : p{A*) = 
1 — ^{npb{'tjj)) + 0 ( 1 ). 

To bound from above the type II error probability, we shall distinguish 2 cases. First, when 
^ 2 p 2 ^ 2 (^) Markov inequality, ( [Xt] ) and (18), to show that /3{A*,G{ip)) -A 

0. Then, when 'n?p'^b‘^['ip) x 1, we have two possibilities: either Es(*4,^)/6('!/:) -A 00 , or 
Es(M^) = 0 {b{il 3 )). We show respectively that either type II error probability tends to zero, 
or we use the asymptotic normality of n{p — T){An — Es(^^)) to get that /3(A*, G('!/>)) < 
^{np{t — b^tp)) + 0 ( 1 ). 

To show the lower bound, we follow the same sketch of proof of lower bounds of Theorems 
[^and[^ The key point for ellipsoids S{A,L) is to check the positivity of the matrix 

nA\l/2 

T,* = Tp{{a*}j>i) where a* = VX[l — ) for all j > 1. 


' / + 

Then we create a parametric family of matrices by changing the sign randomly on each 


diagonal of S*, with parameters given in (16) 


Lemma 2 For ^4 > 0, the symmetric Toeplitz matrix = Tp{{uja*}j>i), where U = 
{uj}j>o with uq = 1, Uj = ±1 for all j > 1, and a* defined as previously, is positive definite, 
for Ip > 0 small enough. Moreover, denote by the eigenvalues of T/fi, then 

|A*f; — 1| < 0{ip ■ ^/\n.{l/'ip)), for all i from 1 to p. 
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Proof of Lemma . Using Gershgorin’s Theorem we get that each eigenvalue of = 

p 

Tp{{uja*}j>i) verifies, |A*^ — ttoo-ol — Wj^j \ = have, 

i>i i>i 


E 

i>i 


= 


^E(i-G) 

i>i 


eU2^xi/2 


<^Eh-( 

i=i 

= 0(l)v/A • T X V-• VRW)- 


^^2A'^ 2 


We deduce that the smallest eigenvalue is bounded from below by 
. min Xi u > o-Q - 2 ^ 0 -* > 1 - 0(1)^' • 

1=1,--^P 


i>i 


which is strictly positive for ■0 > 0 small enough. 


To complete the proof, we follow the steps of the proof of the lower bound in Section 2.2 
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